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Entrance and sojourn times for Markov chains. 
Application to (L, i?)-random walks 
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Abstract 

In this paper, we provide a methodology for computing the probability distribution of sojourn times for a 
wide class of Markov chains. Our methodology consists in writing out linear systems and matrix equations 
for generating functions involving relations with entrance times. We apply the developed methodology to 
some classes of random walks with bounded integer-valued jumps. 
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1 Introduction 

We first introduce some settings: we denote by Z the set of all integers, by Z + that of positive integers: 
Z + = Z fl ( 0 , +oo) = {1,2,...}, by Z _ that of negative integers: Z _ = Z fl (—00, 0 ) = {..., -2,-1}, and by Zi 
that of non-negative integers: Z^ = Z + U { 0 } = { 0 , 1,2,...}. We have the partition Z = Z + U { 0 } U Z~. These 
settings will be related to space variables. We introduce other settings for time variables: N is the set of non 
negative integers: N = { 0 , 1, 2,... } and N* is that of positive integers: N* ={1,2,... }. 

While nearest neighbour random walk on Z has been extensively studied, random walk with several neigh¬ 
bours seems to be less considered. In this paper, we consider this class of random walks, i.e., those evolving on 
Z with jumps of size not greater than R and not less than —L, for fixed positive integers L , R 1 (the so-called 
( L , I?)-random walks). More specifically, we are interested in the time spent by the random walk in some subset 
of Z, e.g., Zf up to some fixed time. 


1.1 Nearest neighbour random walk 

Let us detail the most well-known example of random walk on Z: let be the classical symmetric 

Bernoulli random walk defined on Z. The probability distribution of the sojourn time of the walk (S m ) mg pj in 
Z* up to a fixed time n £ N*, 

n 

T„ = #{m £ {0,... ,n} : S m > 0} = ^ 

ra—0 

is well-known. A classical way for calculating it consists in using generating functions; see, e.g., 0 Chap. Ill, 
§4] or [T8j Chap. 8, §11] for the case of the nearest neighbour random walk on Z, and 0 Chap. XIV, §8] where 
the case of random walk with general integer-valued jumps is mentioned. The methodology consists in writing 
out equations for the generating function of the family of numbers P{T„ = m}, m, n £ N. A representation 
for the probability distribution of T n can be derived with the aid of Sparre Andersen’s theorem (see mum 
and, e.g., m Chap. IV, §20]). Moreover, rescaling the random walk and passing to the limit, we get the most 
famous Paul Levy’s arcsine law for Brownian motion. 

Nevertheless, the result is not so simple. By modifying slightly the counting process of the positive terms of 
the random walk, as done by Chung & Feller in [lj, an alternative sojourn time for the walk ( S m ) m gN in Z^ up 
to time n can be defined: 


n 

Tn = ^ ^ $m with Sm 

m= 1 


1 if (Sm > 0) or (Sm = 0 and S m -1 > 0), 
0 if (Sm < 0) or (Sm = 0 and S m -1 < 0). 


( 1 . 1 ) 
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In T n , one counts each time m such that S m > 0 and only those times such that S m = 0 which correspond to 
a downstep: S m - 1 = 1. This convention is described in [I] and, as written therein- “The elegance of the results 
to be announced depends on this convention” (sic)-, it produces a remarkable result. Indeed, in this case, the 
probability distribution of this sojourn time takes the following simple form: for even integers m, n such that 
0 < m < n, 

p { T„ = m} = M ™ V (»--») j. 

In addition, also the conditioned random variable ( T n \S n = 0), for even n, is very simple: it is the uniform 
distribution on {0,2,. .. ,n — 2 ,n}. The random variables (T n \S n > 0) and (T n \S n < 0) admit remarkable 
distributions as well; see, e.g., na- Hence, it is interesting to work with the joint distribution of (T„, S n ). 

We observe that this approach could be adapted to a wider range of Markov chains. 

1.2 Main results 

In this paper, we consider a large class of Markov chains on a finite or denumerable state space £ and we 
introduce the time T n spent by such a chain in a fixed subset E t of £ up to a fixed time n. Inspired by the 
modified counting process m, we also introduce an alternative sojourn time T n . Let us recall that sojourn 
times in a fixed state play a fundamental role in the framework of general Markov chains and potential theory. 

We develop a methodology for computing the probability distributions of T n and T n via generating functions 
('Theorems 13.11 and 13.211 . The technique is the following: by applying the Markov property, we write out linear 
systems for the generating functions of T n and T n . Though it seems difficult to solve these systems explicitly, 
nevertheless they could be numerically solved. We refer the reader to the famous book [5] Chap. XVI], to [TO] , 
HU, HD, m for an overview on Markov chains and to the recent book [B] for generating functions. 

Next, we apply the general results we obtained to the case of (L, I?)-random walk fTheorems 14.1114.21 and 
14.31) . We exhibit explicit results in the particular cases where L = R = 1, namely that of nearest random walk 
with possible stagnation (' Theorems 15.11 and 15.21) . and where L = R = 2, the case of the two-nearest random 
walk lTheorem l6.il) . In this latter, we illustrate the matrix approach which can be completely carried out. 

In the case of the usual Bernoulli random walk on Z, the determination of the generating function of the 
sojourn time in Tf goes through that of the first hitting time of 0. In this particular example, level 0 acts as a 
boundary for Tf in the ordered set Z. This observation leads us naturally to define in our context of Markov 
chains on £ a kind of boundary, E° say, for the set of interest E' which is appropriate to our problem (see 
Section ©. This is the reason why we restrict our study to Markov chains satisfying Assumptions (Ai) and 
( A 2 ) (see Section HJ). Let us mention that, as in the case of Bernoulli walk, entrance times play an important 
role in the analysis. 


1.3 Background and motivation 

Our motivations come-among others-from biology. Certain stochastic models of genomic sequences are based 
on random walks with discrete bounded jumps. For instance, DNA and protein sequences, which are made of 
nucleotides or amino acids, can be modelled by Markov chains whose state space is a finite alphabet. Biological 
sequence analysis can be performed thanks to a powerful indicator: the so-called local score which is a func¬ 
tional of some random walk with discrete bounded jumps. This indicator plays an important role for studying 
alignements of two sequences, or for detecting particular functional properties of a sequence by assessing the 
statistical significance of an observed local score; see, e.g., HD, HD and references therein. 

Another example in biology concerns the study of micro-domains on a plasmic membrane in a cellular 
medium. The plasmic membrane is a place of interactions between the cell and its direct external environment. 
A naive stochastic model consists in viewing several kinds of constituents (the so-called ligands and receptors) 
as random walks evolving on the membrane. The time that ligands and receptors bind during a fixed amount 
of time plays an important role as a measurement of affinity/sentivity of ligands for receptors. It corresponds 
to the sojourn time in a suitable set for a certain random walk; see, e.g., US- 

Let us mention other fields of applications where entrance times, exit times, sojourn times for various random 
walks are decisive variables: finance, insurance, econometrics, reliability, management, queues, telecommunica¬ 
tions, epidemiology, population dynamics... 

More theoretically, several authors considered ( L , I?)-random walks (i.e., with integer-valued jumps lying 
between — L and R where L and R are two positive integers) in the context of random walks in random 
environment. When fixing the environment, the quenched law they deal with is associated with a ( L , R)- 
random walk. Let us quote for instance a pioneer work |12j : next [3] and [4] where the jumps are +2 and — 1 
(viz. (l,2)-random walk); [5] and recent papers [D, [EJ, [2], corresponding to the particular cases L = 1 or 
R = 1, namely the jumps are 1 in one direction and greater than 1 in the other direction. Many other references 
can be found therein. 
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Iii all the aforementioned papers, one of the main motivation is the study of recurrence/transience and the 
statement of a law of large numbers for random walk in random environment. Important tools for tackling 
this study are passage time, exit time from a bounded interval, ladder times, excursions... in the quenched 
(i.e. fixed) environment. For instance, in [3], the authors study passage time and sojourn time above a level 
before reaching another one. In [7], the authors are able to compute generating function of the exit time of 
(2, 2)-random walk (see also j2] for the case of (1, 2)-random walk). In particular, in 0, we can read: “These exit 
probabilities [in deterministic environment] play an important role in the offspring distribution of the branching 
structure, which can be expressed in terms of the environment” (sic). 

1.4 Plan of the paper 

The paper is organized as follows. In Section [2] we introduce the settings. In particular, inspired by (11.111 . 
we elaborate an alternative counting process. In Section [3] we consider several generating functions and, in 
particular, in Theorems 13.II and 13.21 we describe a method for computing the generating functions of ( T n ,X n ) 
and (T n , X n ) for a general Markov chain satisfying Assumptions (Ai) and (A 2 ). Since the proofs of Thcorem l3.ll 
and 13.21 are quite technical, we postpone them to Section [7] as well as those of auxiliary results. In Section [I] we 
apply the methodology developed for general Markov chains to the class of (L, I?)-random walks by adopting a 
matrix approach. Finally Section[5]and Section [6] are devoted to the more striking examples of ordinary random 
walks and symmetric (2, 2)-random walks. 


2 Settings 

Let (X m ) mg N be an homogeneous Markov chain on a state space £ (which is assumed to be finite or denumerable) 
and let E\ E° be subsets of £ with E° C E^. We set E + = E^E 0 , E~ = £\E t and E± = £\E° = E + U E~. 
Actually, we partition the state space into £ = E + U E° U E~. We will use the classical convention that 
min(0) = +00 and that Y^e= P = 0 if p > q. Throughout the paper, the letters i,j , k will denote generic space 
variables in £ and £, m, n will denote generic time variables in N. We also introduce the classical conditional 
probabilities Pj{- • • } = P{- • • |A 0 = *} and we set Pij = Pj{Xi = j} for any states i, j £ £. 


2.1 Entrance times 

It will be convenient to introduce the first entrance times r°, t\ t + , t~ , in E° , E\ E + ,E~ ,E ± respectively: 

r° = min{m £ N* : X m £ E°}, 
r t = min {to £ N* : X m £ E^}, 
t + = min{m £ N* : X m £ E + }, 
t~ = min{m 6 N* : X m £ E~}, 
t ± = min{m £ N* : X m £ E ± }. 

We plainly have A < r° and r ± == r + Ar~ . Additionally, we will use the first entrance time in E± after time r°: 

t^~ = min{m > r° : X m £ E±}. 


As a mnemonic, our settings write in the example of the classical Bernoulli random walk on £ = Z, with the 
choices E° = {0}, E* = Zt = {0,1, 2,...}, E+ = Z+ = (1, 2, ... }, E§. = Z~ = {..., -2,-1} and E ± = Z\{0}, 


T° 

= min{m 

e 

N* 

: X m 

= 

0}, 

T t 

= min{m 

£ 

N* 

■■x m 

> 

0}, 

T+ 

= min{m 

£ 

N* 

:X m 

> 

0}, 


= min {m 

£ 

N* 

■ X m 

< 

0}, 

-H 

= min {m 

£ 

N* 

■ x m 


0}, 

+1 

= min{m 

> 

t° : 

: X m 


0}. 


We make the following assumptions on the sets E^ and E°: 

(Ai) if Xq £ E ~, then r° = t'. This means that the chain starting out of E' enters E' necessarily by passing 
through E°\ 
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(A 2 ) if Xo £ E + , then r° < r — 1 or, equivalently, r > r° + 1. This means that the chain starting in E + 
exits E' necessarily by passing through E°. 

Roughly speaking, E° acts as a kind of ‘boundary’ of E', while E + acts as a kind of ‘interior’ of E^. These 
assumptions are motivated by the example of integer-valued (L, i?)-random walks for which jumps are bounded 
from above by R and from below by —L (L, R £ N*, L for left, R for right, the jumps lie in {—L, —L + l,..., R — 
1,1?}). If we consider the sojourn time above level 0, we are naturally dealing with a ‘thick’ boundary above 0: 
E° = {0,1,..., M} where M is the maximum of L and R. Section[4]is devoted to this class of random walks. 

2.2 Sojourn times 

We consider the sojourn time of (X m ) m6 pj in up to a fixed time n £ N: T 0 = 0 and, for n > 1, 

n 

T n = #{m£{l,...n}:X m £E'} = ^ l E t(X ro ). 

m— 1 

The random variable T n counts the indices m £ {1,..., n} for which X m £ E^. Of course, we have 0 <T n <n. 
Inspired by the observation mentioned within the introduction concerning the alternative counting process ED, 
we define another sojourn time consisting in counting the m £ {1,..., n} such that 


• either X m £ E + , 

• or X m £ E° and X m _i £ E + , 

• or X m , X m —\ £ E , X m —2 £ E+, 


• or X m ,..., X 2 £ E°, X\ £ E^~. 

Roughly speaking, we count the X m lying in E + or the X m lying in E° ‘coming’ from a previous point lying in 
E + . Let us introduce the following events: B 1 = ^4 0 ,i = {Xi £ E + } and for any m £ N\{0,1}, 

Aq = {X m £ E+y, 

Ae, m = {X m ,X m -i, ..., X m -e + i £ E °} D {X m -( £ E + } for £ £ {1,... ,m — 1}, 

Bm = A() m U Ai m U • • • U 4 m -i, m . 


In other terms, we consider the sojourn time defined by Tq = 0 and for n £ N*, setting S m = 1 B m , 


T n = #{m £ { 1 ,... n} : S m = 1 } = S m . 

m =1 

It is interesting to know when, conversely, we do not count X m through this process. This boils down to 
characterize the complement of B m . For this, we set also B[ = A' 0 x = {Xi £ E~UE°} and for any m £ N\{0,1}, 


^ 0 ,m — {Xm £ E }, 

1 P { X m ■ Xni.— I , ■ 


A’ 

-™-m 


A^ m — {X m ,X m _i,..., X m -e + i £ E°} n {X m -e £ E } for i £ {1,..., m — 2}, 
■—i,m = {Xm, x m ...,X 2 £E°jn{X 1 £E- U E°}, 


R' 


We have the following property the proof of which is postponed to Section 0 
Proposition 2.1 For any m £ N*, the set B’ m is the complementary of B m : B' m = Bt^ 


Remark 2.1 The sets A^^ m , 0 < £ < m—1, are disjoint two by two, and the same holds for A' t m , 0 < £< m— 1. 
Hence, from Provosition \2. 11 we deduce the following identities: 

m m 

S m=^2 1 = 1 B m = 1 - 1 = 1 - 1 B' m = 1 - 

£=o e=o 
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Our aim is to provide a methodology for deriving the joint probability distributions of (T n , X n ) and (T n , X n ). 
For this, we develop a method for computing the generating functions ^m.neN, ^i{T n = m,X n £ F} x m y n ~ m 

('Subsection 13.211 and ]Pm,r.eN: P i{T n = m,X n £ F} x m y n ~ rn (Subsection [33]) for any subset F of £. When 

F = £ , these quantities are simply related to the probability distributions of T n and T n . When F = {i} for a 
fixed state i £ £, this yields the probability distributions of the sojourn times in E' up to time n for the ‘bridge’ 
(i.e., the pinned Markov chain) ( X m \X n = i) m e{o,...,n}- 

Actually, concerning T n , we will only focus on the situation where Xo £ E°,X i £ E ± for lightening 
the paper and facilitating the reading. That is, we will only provide a way for computing the probabilities 
P,{Xl £ E ± ,T n = m,X n £ F} for i £ E° (Theorem 13.21) . The study of T n subject to the complementary 
conditions X 0 ,X\ £ E° or X 0 ^ E° could be carried out by using the results obtained under the previous 
conditions. We explain below with few details how to proceed. 

• Under the condition Xo, X\ £ E°, we consider the first exit time from E°, namely . Then, the first terms 
of the chain satisfy Xo,Xi, ... ,X T ±_ 1 £ E° and X T ± £ E± and we have T t ±_ 1 = 0. Viewing the chain 
from time r ± — 1, the facts X T ±_i £ E°,X T ± £ E± are the conditions analogous to Xq £ E°,X i £ E±. 

• Under the condition Xo ^ E°, we consider the first entrance time in E °, and next the first exit time from 
E°, namely f ± . Then, the first terms of the chain satisfy Xo, X \,..., X T o_ 1 £ E±, X T o ,..., Xf±_i £ E° 
and Xf± £ E± and we have T?±_\ = f ± — 1 if Xq £ E + and T ?±_i = 0 if Xo £ E~. From time f ± — 1, 
the facts X f ±_i £ E°,X f ± £ E ± are the conditions analogous to X 0 £ E°,X 1 £ J E ,=b . 

In both situations, we could perform the computations by appealing to identities similar to (17.101) (which are 
used for proving Theorem 13.21) with the help of Markov property. We will let the reader write the details. 

3 Generating functions 

3.1 Generating functions of X,r 0 ,rt,r+,r- 

Let us introduce the following generating functions: for any states i, j £ £, any subset F C £ and any real 
number x such that the following series converge, 


Gij(x) = J2 = 3} Gi(x) = ]T Fi{X m £ F}x m = Y, G b(z), 

m =0 m —0 j€.F 

oo 

H U X ) = E P ^ T ° = m ’ X -° = 3}x m = E* (s T °l { x TO =j } ), 

m— 1 

= Ej (x T ^ 1 {x^=j}), H±{x) = Ei(a; T+ l { x T+=J ' } ), Hr.( x ) = E;(a; T l { x T _=j})- 

In the above notations, the indices i and j refer to starting points and arrival points or entrance locations while 
superscripts o, f,+, — refer to the entrance in the respective sets E °, E ', E + , E ~. Moreover, for lightening the 
settings, when writing X T u = j in H^(x), u £ (o, f, +, —}, we implicitly restrict this event to the condition that 
t u < +oo and we omit to write this condition explicitly. 

For determining Gij(x), the standard method consists in using the well-known Chapman-Kolmogorov equa¬ 
tion: for any m £ N, i £ (0,..., to} and i, j £ £, 

P i{X m = j} = E p k{X m - e = j}. (3.1) 

fee£ 

In particular, by choosing £ = 1 in ED, we have, for to > 1, that 

P i{X m = j} = $> fe P fc {A m _i = j} 

kes 

and we get that 

OO / \ OO 

Gij(x) = Sij + J2 Y,PM X ™-i = j} + E^ fc E p fc(^m -1 = 3}x m . 

m— 1 \ kGS J k££ m—1 

We obtain the famous backward Kolmogorov equation 

Gij (x) = Sij + X E PikGkj (x) for i,j £ £. (3.2) 

ke£ 
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Similarly, by choosing l = m — 1 with m > 1 in m , we get the forward Kolmogorov equation 

= 5jj +a?y ^pkjGjkjx) for i,je£. (3.3) 

For determining we observe that for i G £, j G E° and m £ N*, if Xo = i and X m = j, then the chain 

has entered E° between times 1 and to. In symbols, appealing to the strong Markov property, 

m 

= j} =Pi{r° < to, X m =j}=^ 5Z Pi{r° =£,X T o = k} P fe {X m _^ = j}. 

e=i keE° 


Therefore, 


oo / m \ 

Gij{x) = P,{Xo =j}+J2\J2J2 P *A° = = k}V k {X m _, = j} \x m 

m=l \ £=1 keE° / 

oo oo 

= Sij + 5Z 51 P ^ T ° = ^ X -° = 51 p k{X m -e = j} X m 

i—\ k£E° m—t 

oo 

= 6ij + J2J2 P ^ T ° = = k } * l G kj {x) 

e=ikeE° 

= ~b ^ ^ ^-{X T u =fc}) G k j (x). 

k£E° 


We get the equation 

Gij{x) = Sij + ^2 H °k( x )G k j{x) for i G £,j G E°. (3.4) 

keE° 

Let us point out that, due to Assumptions (Ai) and (A 2 ), (13.411 holds true for i G E + , j G E~, and also for 
i £ E~ , j £ E'. In the same way, we have that 

Gij(x) = + ^2 H ik( x )Gkj(x) for i £ £, j £ E\ 

fceBt 

Gij{x) = 5^ + ^2 H ik( x )Gkj(x) for iG £,j £ E + , 

k£E+ 

G tj (x) = Sij+ ^2 H~ k {x)G k j{ x ) for i £ £, j £ E~. 

kGE- 

Moreover, if i £ E~, then, by Assumption (Ai), A = r° which entails that Hj-(x) = H°j(x). If i £ E + , 
then, by Assumption (A 2 ), A = 1 which entails that Hjj(x ) = pij x. If i £ E°, 

H ij(?)= J2 Ei(z Tt l{ Xl=fc)XT t=y}) + J] Ej (A* l { x 1 =fe,x Tt =j } ) • 

fcest fcc£- 

If Xi £ iA, then -A = 1 while if Xi £ E~ 1 then -A = r°. Now, let us introduce the first hitting time of 
iA by (X m )meN : A' = min{m £ N : X m £ iA}. Of course, we have A' = 0 if X 0 £ iA, A' = A if 
Xo £ E _ and A' is related to A according to A = 1 + A' o 6b where 6b is the usual shift operator (acting as 
X m o Oi = X m _j_i). Moreover, X T t = X T t/ o 9 1 . With these settings at hands, thanks to the Markov property, 
we obtain E i(x T 1{x 1 = k ,x t =j}) = Pik x Efc (x T l{x t , =y>) which yields that 


(3.5) 

(3.6) 

(3.7) 


Ej(A l{Xi=fc,x Tt =j}) 


SjkPikX if fc £ iA, 

Pi k xE k (x T °l{x T o=j}) if keE~. 


As a result, we see that the function iA can be expressed by means of iff- according to 


H\Xx) = < 


H°j{x) 

if i £ E , 

Pij X 

if i £ E+, 

X \Pij + 51 PikH kj (x) 

if * £ E°. 


k£E~ 


(3.8) 
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Iii the sequel of the paper, we will also use the generating functions below. Set, for any i £ £ and j £ E °, 


Hfj ( x ) = ^i(x T l{A'i£Bt,x T o=j})> 

= ^i{x T l{X 1 £.E+,X,.o=j})j 
=^i{x T !{ Xl eE-,x T o=j})- 

In short, x), u, v £ {o, f,+, —}, is related to time r“ and the first step X\ £ E v . We propose a method 
for calculating H° + (x) and H°~ ( x ). For this, we introduce the first hitting time of E° by (X m ) me ^: 

t°' = min{m £ N : X m £ E°}. Of course, we have r°' = 0 if X 0 £ E°, t° ’ = r° if X 0 ^ E° and r°' is related 
to r° according to r° = 1 + r°' o 9±. Moreover, X T o = X T o, o Q 1 . With these settings at hands, thanks to the 
Markov property, we obtain, for any i £ £ and j £ E° , that 

H°-{x) =X Y Pik^k(x T °' 1{x t o/=j}) =®( Y PikSk J + P i k^k{x T ° t { x T o=j}) 

feeBt V k£E° k&E+ 


which simplifies into 


Similarly, 


H ij{x) = x(p i:i + Y PikHkj(x) j. 

V k£E+ / 


H ij{x)=X Y Pik H kj(x), H?j {x)=X Y Pik H kj{x) 

k£E+ k&E~ 


(3.9) 

(3.10) 


3.2 Generating function of T n 

Now, we introduce the generating function of the numbers P i{T n = m,X n £ F}, m,n £ N: set, for any i £ £ 
and any real numbers x, y such that the following series converges, 

Ki(x,y)= Y P*{T n =m : X n £F}x m y n - m . 

m,ne N: 

m<n 


In the theorem below, we provide a way for computing Ki(x,y). 
Theorem 3.1 The generating function Ki, i £ £, satisfies the equation 


Ki(x, y) = Ki(x , 0) + Ki( 0, y) + Y ( H °j( x ) + ~ H °j (v )) K A X > v) ~ Y H ij( x ) K i( x ’ °) ” M*) ( 3 - n ) 

j&E° ' V ' jeE° 

where, for any i £ £, 

Ki(x, 0) = Gi(x) - Y H~ j (x)G j (x), Ki(0,y) = G^y) - Y H} 0 {y)G 3 (y), (3-12) 

j£E- jeEt 

and where the functions Hfj, j £ E~, and iff, j £ E\ are given by S3.5\ ) and and the functions H°J 

and H°~ , j £ E° are given by S3.9\) and S3.10\) . 


Remark 3.1 If we choose F = £, for all state i in £, we simply have Gi(x) 


jY and S3. 1 HI) yields that 


, l-Ei(x T ) , 1-E Ay T ') 

Ki(x, 0 =- Ki(0,y)= > . 

1 — x 1 — y 

Remark 3.2 If E° reduces to one point io, then, for i = io, S3.11\) immediately yields 

(1 - H* o (x))K io (x, 0) + K io (0, y) - 1 F (i 0 ) 


Ki 0 {x,y) = 


i -H°Ux)-- v H°~(y) 


y ' 


Moreover, H°^ io (x) and H° oio (y) can be computed thanks to S3. .91) and S3. 1 (A) with the aid of Hf io {x) = Gki 0 {x) / Gi 0 i 0 (x) 
which comes from [3.1$ . 

Let us mention that due to (13.111) . it is enough to know K$x, y) only for i £ E° to derive Ki(x, y) for i £ £\E°. 
Indeed, we have the connections below. 
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Proposition 3.1 For i £ £\E°, Ki{x,y) can be expressed by means of Kj(x,y), j £ E°, according to the 
following identities: if i £ E + , 

Ki(x,y) = Gi{x) - Y H °jto G j( x ) + Y H ij( x ) K i( x >y) ( 3 - 13 ) 

jeE° jeE° 

and if i £ E~, 

Ki(x, y) = Gi(y) - Y H°(y)G,(y) + ^ ]T H° 3 {y)K 3 (x , y). (3.14) 

je£° V j&E° 

3.3 Generating functions of and f 1 * 1 

From now on we restrict ourselves to the case where Xq £ E° and X\ £ E ± . In Subsection l2.2l we indicate how 
to treat the complementary case. Let us introduce the following generating functions: for any i,j£ E°, 

OO 

Kjto = E *( :rT± ~ 1]L {^ T ±_ 1 =j}) = Y P ^ T± = m i x r±-i = j}®™ -1 , 

m =1 

oo 

H-ti*) = M xf± ~ ll {XiZE+,x r± _ 1 = j} ) = Y G E+ ’ f± = m ,Xf±-! =j}x m -\ 

m =1 
oo 

K~to = E i (® f± - 1 l {XieB -, Xf± _ i=i} ) = Y P ‘{ X i G E- : f ± =m,X f± _ 1 =j}x m ~ 1 . 

m —1 

By noticing that f ± = r° + o 0 T o where 0 T o acts on (X to ) to£ n as X m o 0 Ta = X m+T o and by using the strong 
Markov property, we have that 

H± + (x)= Y E*(* Tl l{jfieE+,x T o=fe})]EA,.(x T± - 1 l {Xr± _ i=j} ), 
fceB° 

and a similar expression holds for In short, we have obtained that 

K + to = Y KktoKjto, Hff{x) = Y KktoKjto, 

keE° keE° 

and, by (13.101) . 

H± + {x)=x Y PikKtoKjto, Htj~( x )= x Y Pik H ke( x )Htj(x). (3.15) 

k&E+,eeE° k£E-,eeE° 

Hence, we need to evaluate H±(x) for i,j £ E°. We note that, if X\ £ E ± , then r ± = 1 and X T ±_ x = X 0l 
so that we get 

H tjto = E l (x r± - 1 l{ A - ieB d :) . YT± _ i=J }) +E l (x T± - 1 l {XieE o,x T± _ 1 =j}) 

= SijPi{Xi £ E 1 ^} + x Y = fc } E fc( a;T±_1 l{X T± ^ 1 =i})- 

keE° 

As a result, we obtain the following equation: for i,j G E°, 

H*(x) = 5 tj PifX, £E ± } + xY PikH%{x). (3.16) 

keE° 


Remark 3.3 If E° reduces to one point io, then S3.16V immediately yields H± iQ {x) = (1 — Pi 0 i 0 )/(1 — Pi 0 i 0 x ) 
which in turn yields that 




If we additionally impose the (more restrictive) condition that the Markov chain does not stay at its current 
location in E°, that is, pa = 0 for any i £ E°, then we simply have H^ io (x) = 1, H^Jf o (x) = H°f Q (x) and 


Kioto = Kioto- 
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3.4 Generating functions of X, t + ,t subjected to X 1 6 E ± 

In what follows we need the generating functions below: for any i £ E°, we set 

OO 

G+(X) = P <{*1 G E+ , X ™ € F}®"*, 

m—0 
oo 

Gr(*) = E p 4 *i G G F } x ™; 

m—0 

for i £ E°,j £ E~, 

OO 

#ij + (z) = E P*{^i 6 £ + ,r _ =m,X T - =j}x m = Ej(cc r l{x l6 B+,x T _=i}); 

m=l 

for i £ E°,j £ £’ + , 

OO 

= E P *{ X i € E~,t + = m,X T + =j}x m =Ei(x T+ l {XieE -,x T+ =j } )- 

m= 1 

By the Markov property, we clearly have that 

Gf(x) = lF(j)Pi{Ii £ E + } +x ^2 PijGj(x), G~(x) = 1f(*) p »{-^i e E ~} + £ E PijGj(x) (3.17) 

jeE+ j£E- 

and 

H ij + ( x ) =X E Pik H kj( x )’ H ij~( x ) = x E Pik H kj(x)- ( 3 - 18 ) 

k£E+ keE~ 


3.5 Generating function of T n 

Now, we introduce the generating function of the numbers Pj{Xi 6 E±,T n = m,X n £ F}, m,n £ N: for any 


i £ E°, 


Kfix,y) = J2 Wi{Xi£E ± ,f n = m,X n eF}x m y n - m 

m,nGN: 


In the following theorem, we provide a way for computing Kfix,y). 
Theorem 3.2 The generating function Ki, i £ E°, satisfies the equation 


K i (x,y) = K i (x,0) + K i (0,y)+Y^ (^ + W + ^ (y))Kj{x,y) 

jGE° 

- E H± + ( x )Kj(x,0) - J2 - 1f(*)P,{*i € E ± }, (3.19) 

jefi” ies° 


where, for any i £ E°, 


Kfix, 0) = Gf (x) — J2 H- j +(x)G j (x) + l F {i)V i {X 1 €E~}, 


j£E~ 


Ki(0,y) = G~(y) - J2 H+ j ~(y)G j (y) + Mi) p i{*i £ E+}, 

j€E+ 


(3.20) 


and where the functions HX and H^ , i,j £ E°, are given by t3.15\) and the functions HX, i £ E°, j £ E , 
and HX, i £ E°, j £ E + , are given by \3.18\) . 

Remark 3.4 If we choose F = E, for all state i in £, we simply have Gfi (x) = Pj{^i £ E + }/( 1 — x) and 
G~ (x) — P i{Xi £ E~}/( 1 — x), and \3.20\) yields that 

Kfix, 0) = Y^(Pi{Xi £ E ± } - xFfiXx £ E~}-x ^ p tJ E,- (x T )), 

j£E+ 

KfiO,y)=j^-(p i {X 1 €E ± }-yP l {X 1 GE + }-y ^ Pij E, (y T+ )) ■ 

V j&E- 

In view of Remark [3~3l if E° reduces to one point iq, then (13.191) immediately yields the explicit expression 
below. 
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Corollary 3.1 If E° reduces to one point io, then 


k , . (i-g^W)^a(^Q) + ( 1 -gt~(y))^io(o.y)-M»o)( 1 -Pi,io) 

1 ~ Hf^) - Ht 0 ~(y) 

Moreover, under the additional assumption that the Markov chain does not stay at its current location in E°, 
that is pu = 0 for any i £ E°, the generating function Ki 0 can be simplified into 

7> , , (1 - H°X(x))K io (x,0) + (1 - H°~ io (y))K io (0,y) - l F (*o) 

o[X,y) i 

4 Application to (L, i?)-random walk 

The algebraic equations (13.111) and (13.191) satisfied by the generating functions K z and K L , i £ E °, produce 
linear systems which may be rewritten in a matrix form possibly involving infinite matrices. In this section, we 
focus on the case of the (L, l?)-random walk. In this case, the systems of interest consist of a finite number of 
equations and may be solved by using a matrix approach that we describe here. We guess that this approach 
provides a methodology which should be efficiently numerically implemented. 

4.1 Settings 

Let L,R be positive integers, M = max(L,i?) and let (Ue)eeN* be a sequence of independent identically dis¬ 
tributed random variables with values in {— L, —L + 1,..., R — 1,1?}. Put n 7 = P{f 7 i = *} for i £ {— L, ..., R} 
and 7Tj = 0 for i £ Z\{— L ,..., R}. The common generating function of the Ufs is given by 

Ft L-\-Ft 

E {y Ul ) = y° = y~ L H n i~ L y J - 

j = —L j =0 

Let Xq be an integer and set X m = X 0 + YFeFi f° r an Y w £ N*. Set Uq = Xq, and notice that X m is the 
partial sum of the series Ue. The Markov chain (X m ) mg N is a random walk defined on £ = Z with transition 
probabilities defined as p t j = P{X m+ i = j \ X m = i} = 7T ? _i. The jumps are bounded and we have that 

Pij = 0 for j ^ {i — L, i — L + 1,..., % + R}. (4.1) 


We choose here 


E° ={0,1,...,M-1}, 

#={0,1,...}, 

E+ ={M,M+1,...|, 

E~ ={...,-2,-1}. 

The settings of Section [2] can be rewritten in this context as 

T n = #{m £ {1,..., n} : X m > 0}, 

r° = min{m £ N* : X m £ {0,1,..., M — 1}}, 

r'i = min {m £ N* : X m > 0}, 

r + = min{m £ N* : X m > M}, 

t~ = min {to £ N* : X m < —1}. 

It is easy to see that Assumptions (Ai) and (A 2 ) are fulfilled. Indeed, 

• if X 0 < 0, then Xq, X- t ,, X T ]_ x < 0 and X T t > 0. Since X T t = X T f_ 1 + U T t, X T t_ 1 < — 1 and U T t < R, 
we have X T \ < R — 1 < M — 1. Thus = r°; 

• if Xq > M, then Xq, X x ,..., X T -_ x > 0 and X T - < 0. Since X T -_ x = X T - — U T ~, X T ~ < —1 and 
U T - > —L, we have X T -_ x < L — 1 < M — 1. Thus r° < r~ — 1. 

Now, we can observe the following connections between the foregoing times. Invariance by translation implies 
that upshooting level M (respectively downshooting level —1) when starting at a level i < M — 1 (respectively 
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i > 0) is equivalent to upshooting level 0 (respectively downshooting level M — 1) when starting at a level i — M 
(respectively i + M). In symbols, we have that 

Pi{r _ = m, X T - = j} = P 1 +m {t° = rn, X T o = j + M} if i > 0, 

Pi{r + = to, X T + = j} = P i_M{T° = to, X T o = j — M} if i < M — 1, 
and we deduce the identities below: 


= H°_ Mj _ M (x ) for any i < M — 1, H ZJ (x) = H° +Mj+M {x) for any i > 0. 


(4.2) 


Additionally, by 


hUx) = < 


(H°(x) 
Pij x 


if i < — 1, 
if i > M, 


-l 


(4.3) 


Pij + E Pik H kj(x) ) if 0 < i < M - 1. 
V k— — M J 


4.2 Generating function of X 

Recall that Gij (x) = X)m=o = j} x m . In the framework of random walk, we have the identity Gij = Goj-i 

for any integers i,j ; then it is convenient to introduce the notation r ? = Goj so that Gij = Tj_i. We have the 
result below. 

Proposition 4.1 The generating function Tj_i admits the following representation: for x 6 (—1,1), 


G-i(x) = < 


J+L 1 ifi > j 

etc- P *( Ze ( x ^ 

l£C+ 


p L{zi(x)) 


where z^(x), i G {1,..., L + R}, are the roots of the polynomial P x : z i—>• z L — xYhj^Q^j-LZ 3 and 
C+ = {te{l,...,L + R}: \z t (x)\ >1}, C~ = {l G {1,..., L + R} : \z e {x)\ < 1}. 

Proof 

We introduce the double generating function of the numbers Fo{X m = j}, m € N, j S Z: 

OO / \ OO OO 

G(x,y) = j{x)y 3 = ( E IPo { Xm = i}y° p™ = E E o(y Xm ) xTn = E [ xE (y Ul )]' 

jez m —0 \ jez / 


m—0 


m—0 


which can be simplified, for real numbers x,y such that |x| < 1, into 


(4.4) 


G(x,y) = 


! - x E(y u ' ) y L _ x TTj-LV j 


Let us expand the rational fraction y > G(x, y) into partial fractions. For this, we introduce the polynomial 
P x {z) = z L — x Y’f-u Kj-Lzi and assume that |x| < 1. We claim that the roots of P x have a modulus different 
from 1. Else, if c 10 was a root of P x , we would have E(e lS!71 ) = 1/x. This equality would simply entail that 
|x| = 1/ |E(e 10c/l ) | > 1 which contradicts our assumption on x. Denote by zt (x), t £ {1,..., L + R}, the roots 
of P x . By the foregoing discussion, we can separate the roots having modulus greater that 1 from those having 
modulus less that 1; they define the two sets C + and C~. With these settings at hand, we can write out the 
expansion of G(x,y) as 


L+R 


G(x,y) =Y.JT 


ze(x) 1 


1 


jYi P xi z i{ x )) y~ ze{x)' 
Next, by applying Taylor and Laurent series, we get 

+ OO 


1 


y - zz{x) 


= 


E 

3=0 

-1 

E 


y J 


zt(x)i +1 

y j 

zt(x)i +l 


if l € C + and \y\ < min^ gjC + |^(x)|, 


if £ £ £ and \y\ > max^ g £- p(x)|, 


\J——oo 

and, since Gij(x) = Tj_j(x), we extract by identification flop . □ 
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4.3 Generating function of T n and T n 

Our aim is to apply Theorems 13.11 and 13.21 to (L, i?)-random walk. First, we make the following observations 
which will be useful: 

• if Xq > 0, then X T - £ {— M, ..., —1} and if Xq < M — 1, then X T \ £ {0,..., 2 M — 1} and X T + £ 
{M ,..., 2M — 1}; 

• if rl > 1, then X T t < M — 1, or, equivalently, if X T -t > M, then = 1. Thus = pij y if j > M. 

Now, we rephrase Theorem Id. II in the present context. 

Theorem 4.1 The generating functions Ki, i £ {0,..., M — 1}, satisfy the system 

M—l / 2M-1 -1 \ 

K i(x,y) =x ^2 [pij+ Y, P* H °kAx)+ Y PikHkj(y))K j (x,y)+K i (x,0) + K i (0,y)-l F (i) 


3=0 


k—M 


k=-M 




M—l / 2M-1 \ 

- X Y ( Pij + Y P* kH kj( X ) ) K .l( x > °)> 0 < i < M - 1, 

j =0 \ k—M ) 


(4.5) 


where 


M -1 


K%(x, o) = Gi(x) - Y H i+Mj( x ) G 3 -M(x), 

3=0 

2M-1 M—l -1 

Ki(0,y) = Gi(y) ~y Y Pij G j(v) - V Y H Pik H kj(y) G j(y), 

j= 0 j= 0 k——M 

and where the functions Hf- solve the systems 
M-l 

Y H° k (x)G, ej (x) = G ij(x), M < i < 2M - 1, 0 < j < M - 1, 

k— 0 
M-l 

Y H °k(y) G kj{y) = Gij{y), -m < i < -1, o<j<M-i. 


(4.6) 


(4.7) 


fe =0 


Proof 

By the observations mentioned at the beginning of this subsubsection, Equations (Id. 1211 take the form, for 
0 < i < M — 1, 

-l 

K t (x,0) = Gi(x) - Y H ij( x ) G j( x )’ 

j=—M 

M-l 2M-1 

Ki(0,y) = Gi(y) - Y H ij(y) G j(y) - V Y Pv G Ay)i 

3=0 j=M 

which can be rewritten, due to (14.21) and (I4.dll . as (14. 6H . These latter contain the terms H°j(x ), M < i < 2M—1, 
0 < j < M—l , and H°j(y), —M <i< —1, 0 < j < M—l. By (14.111 and (Id.411 we see that they solve Systems (14.711 . 

Next, in order to apply (Id. 1111 to compute Ki(x,y), we have to evaluate the quantities H°-(x) and H°~(y). 
Because of S3, in view of (|3.9f) and (13.10|) . we have that 

/ \ / 2M-1 \ 


H°J(x) =x[pij+ Y Pik H kj( X ) )= x [p^ 3 + Y P' kH kA x ) ), 0 < i, j < M — 1, 

\ fcez: / \ k=M ) 

M<k<i + R 

-1 

H ij~(y) = y Y PikH k j{y) = y Y Pik H kj(y)i 0 <i,j <M -l. 


fceZ: 

i-L<k <-1 


k——M 


Finally, putting these last equalities into (Id. 1111 yields (14.511 . □ 

Now, let us rephrase Theorem Id.21 in the present context. Set Wi = Fi{X i < — 1 or X\ > M}. 
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Theorem 4.2 The generating functions Ki, i G {0, ..., M — 1}, satisfy the system 


M—l / 2M-1M-1 -1 M-l \ 

Ki(x,y)= Y [ x Y ^2Pi kH u( x ) H ^j( x )+y Y Y Pi kH ke(y) H ±j(y) )Kj(x,y) 

j =0 V k—M £—0 k— — M £—0 J 

M-12M-1 M-l M—l -1 M—l 


~ X Y Y Y PikH M( x ) H (j( x )^j( x ^)-yY Y Y Pi kH ke(y) H tj(y)Kj{o,y), 

j =0 k=M £=0 j —0 k= — M £—0 

+ Ki(x , 0) + Ki( 0, y) — 0 < i < M — 1, 


(4.8) 


where 


2M-1 M—l 3M —1 

Ki(x,0) = x Y Pij G j( x ) - X Y Y Pik-MH%j(x)Gj^ M (x) + 

j—M j= 0 k—2M 

-1 M-l -M-l 

= y ^ ^ PijGjiy) — y Y Y Pi k+M Hkj (y)Gj+ M (y) + 1 

j= — M j= 0 k=—2M 

and where the functions H ?■ and H ^ sofee i/ie systems 

M-l 

Y H °k( x )Gkj (x) = Gij (x), M <i< 2M — 1 (Vesp. 2M <i<3M -1), 0 < j < M - 1, 

fe=0 

M-l 

Y H ik(y)Gkj{y) = Gij(y), -M <i <-1 fresp. -2M < i < -M - 1), 0 <j<M- 1, 

fc—o 
M-l 

Y ik - Pikx)Hfj(x) = SijZUi, 0 < i,j < M - 1. 

fc=0 


(4.9) 


(4.10) 

(4.11) 

(4.12) 


Proof 

By the observations mentioned at the beginning of this subsubsection and by applying formula (18.1711 . Equa¬ 
tions (18.2011 take the form, for 0 < i < M — 1, 


Ki(x,0) = G^“(a;) — ^ H ii + {x)G j {x) + 1f(*)P;{Ai < -1}, 

j=—M 

2M—1 

Ki(0,y) = G~(y) - Y H+-{y)G 3 (y) + > M}. 

j=M 

And, by (|4.ip . Equations (|3.18() yield that 

2M—1 

ff^ + (ar) = a; ^ 0 < z < M - 1, -M < j < -1, 

k—M 

-1 

= y Y o < i < m -1, m < j < 2M -1. 

k=—M 


(4.13) 


(4.14) 


Actually, the terms H~f{x), M < i < 2 M — 1, — M < j < —1 and H^(y), —M < i < —1, M < j < 2 M — 1 are 
directly related to the function Hf- according to (14.21) . Hence, putting (14.21) into (14.1411 . and next the obtained 
equality into Equations (14.131) . these latter can be rewritten as (14.91) . 

On the other hand, by (13.41) . the terms H°-(x), 2 M <i< 3 M — 1, 0 < j < M — 1, and H°-(y), —2 M <i< 
— M — 1, 0 < j < M — 1 lying in (14.91) solve Systems (14.101) and (14.111) . 

Additionally, by rewriting Equations (13.151) as 

2M-1M-1 -1 M-l 

H± + (x) = x Y Y Pik H ke( x ) H tj( x ), H^-{y)=y Y Y Pik H ke(y) H ej(y), 

k—M £—0 k— — M £=D 

and putting them into (13.191) . we derive (14.81) . 

Finally, thanks to (13. 1611 . we see that the terms Hfr,- solve System (14.121) . □ 
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Since all the systems displayed in Theorem Id. II and 14.21 are linear and include a finite number of equations, 
it is natural to solve them by matrix calculus. For this, we introduce the matrices below. We adopt the 
following intuitive settings: the subscripts +, t (double-plus), — , = (double-minus) refer to the appearance of 
the quantities +M, +2M, —M, —2 M in the generic term of the corresponding matrices, the subscript f refers 
to the set of indices {0,..., 2 M — 1} while the superscripts +, —, ± refer to the events {X 4 > M}, {X 4 < — 1}, 
{Xi < — 1 or X 4 > M}. So, with these conventions at hands, we set 



If = (M*))o<i<M_:L’ = (M*Mo<i<M-i 


r(x) = (r J -_ i (x)) 0 <. |i < Af _ 1 , 

P- ( 7T j- i ~ M )o<iJ<M-l 1 ( 7r t-Oo<i<M-l,0< 4 <2M-l’ 

r_(x) — (r j-i- M {x)) 

P=(x) = ( r i-i- 2 MW) 0 ,. i , lf _ 1 , 

r+(x) = (r j-i +M {x)) 0<ij<M _ 1 

, T|(x) = (T j- i+ 2 M (x)) 

G(x) = (G i (x)) 0 ^ M _ 1 , 

G—(x) = (G i _ M (x)) 0S .< M _ 1 , 

G + (x) = (G i+M (x)) 0 < i<M _ 

_!> Gf(x) = (Gi(x)) Q ^.^ 2M _ 1 , 


K 0> y) = y))o<i< M -v k(*. y) = (*<(*> y)) 0 <i< M -v 

Example 4.1 Consider the case where M = 2, that is the case of the -at most - four nearest neighbours random 
walk (including the (1,2)-, (2,1)- and (2,2)-random walks). In this situation, the walk is characterized by the 
non negative numbers tt-2, 7t_i, 7To, tti, 7t 2 such that 7r_2 + 7r_i + 7To + 7Ti + 7t 2 = 1 and we have iti = 0 for 
i 6 Z\{—2, —1,0,1, 2}. Recall the notation Tj = Goj for any integer j. Below, we rewrite the previous matrices: 


1 = 


1 0 
0 1 

P = 


r± 


TTq 7Tl 
7T_1 7T 0 


1 — 7To — 7Tl 0 

0 1 — 7Tq — 7T_l 


, A,(0)\ 

lF ‘ W(1)J' 


P + = 


7T 2 0 

7Tl 7T 2 


P_ = 


7T—2 7T-1 

0 7T_2 


r(x) = 


r 0 (x) Ti(x) 
r_i(x) To{x)J’ 

r = (x) = 


r+(x) = 


r 2 (x) r 3 (x) 
r^x) r 2 (xW ’ 


Pt = 


r-(x) = 


f 1f(0)(1 7T 0 7Ti) 

V 1f( 1)(1 - TTQ - TT-lW’ 


7To 7Tl 7T2 0 
7T-1 7T 0 7Tl 7T 2 


r_ 2 (x) r_i(x) 
r_ 3 (x) r_ 2 (x) 


r_ 4 (x) r_ 3 (x) 
r_ 5 (x) r_ 4 (x) 


G(x) = 


G 0 (x) 

G 4 (x) 


G + (x) = 


K(x, y) = 


G 2 (x) 
G 3 {x))' 

Ko(x,y) 

K\ (x,y) 


, r t (x) = 

G-(x) = 


r 4 (x) r 5 (x) 
r 3 (x) r 4 (xW’ 


G_ 2 (x) 
G-i(x) y ’ 


G t (x) = 


/ G 0 (x)\ 
G 4 (x) 
G 2 (x) 

\G 3 (x)J 


K(x,y) = 


K 0 {x,y) 
Ki{x,y))' 


Theorem 4.3 The generating matrix K admits the representation K(x,y) = D(x,y) : N(x, y) where 

d(x, y) = i — x(p + p+r_(x)r(x)" 1 + p_r + (y)r(7/) _1 ), 

n(x, t/) = (i - x(p + p+r_(x)r(x)- 1 )) (G(x) - r_(x)r(x)- 1 G_(x)) 

+ G (y) - yP t G t (y) - y P_r + (y)r(j/)- 1 G(y) - 1 F . 

The generating matrix K admits the representation K (x,y) = D(x, y) _1 N(x, y) where 

D (x,y) = I - xP+r_(x)r(x)- 1 (I - xP)- 1 ^ - 7/P_r + (7/)r(y) _1 (I - y P)- 1 ^, 

N(x, y) = (I - xP + r_(x)r(x)" 1 (I -iP)' 1 ^) x (l+ + xP+(G + (x) - r = (x)r(x)- 1 G_(a 


+ (I - 2 /P_r + (y)r( 2 /)- 1 (I -y P)- 1 ^) x (l± + j,P_(G_(y) - r t ( y )r(y)- 1 G+ 


(4.15) 


(4.16) 


- 1 


F ' 


In Section [5l we will apply this theorem to the ordinary random walk (corresponding to the case M = 1), 
and in Subsubsection ECU we will apply Theorem 14.31 to the case of the symmetric (2, 2)-random walk. 
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5 Ordinary random walk 


In this section, we consider ordinary random walks on £ = Z, that is, those for which L = R = 1 (and then 
M = 1). They are characterized by the three probabilities 7r_i,7To,7ri that we respectively relabel as q,r,p for 
simplifying the settings: 

q = P{U 1 =- 1}, r = P{f7i = 0}, p = P{Z7i = 1}. 


We have of course p + q + r = 1 and 


Pij = 


'q if i = * — i, 

r if j = i, 
p if j = i + 1, 

,0 if j £{i- 1, i,i+l}. 


We choose E° = {0}, = {0,1,2,...}, E + = {1,2,...}, E~ = {..., —2, —1}. Without loss of generality, we 

focus on the case where the starting point is located at 0, i.e., in the current settings, we choose i = 0. Our aim 
is to apply Theorem 14.31 to this example. 

The roots of the polynomial P x (z) = — (px z 2 — (1 — rx)z + qx) are expressed as 


l-rx- y/A(x) l-rx + A(x) 

z ( x > = -TZT-. CW = - 


2 px 


2 px 


where A(x) = (1 — rx) 2 — Apqx 2 . They are chosen such that \z(x)\ < 1 < |C(x)| for x £ (0,1). We have 
z(x)((x) = q/p and P' x {z) = —2 px z + (1 — rx). In particular, P' x (z(x)) = —P{(C(x)) = y/A(x). 

Formula (14.411 yields, for x £ (0,1), that 


z(x) 


i-J 


Tj-i{x) = 


V A ( x ) 


C( x ) 


i-3 


V A ( x ) 


if i > h 


if i < j. 


In particular, 


r o( x ) = 7== , T_i(x) = 7 == , Ti(x) = 


1 


pz{x) 


V A ( X )‘ 

r_ 2 (x) = 


z(x) 2 


V A ( X ) 

, r 2 (x) = 


C(x)yA(x) qyj A(x) 

1 p 2 z(x) 2 


\/A(x) (W 2 \MW q 2 V A (x) 

Next, we rewrite the matrices of Subsubsection l4~3l with the convention that for matrices with one entry, we 
omit the parentheses and assimilate them to numbers: 

1=1, I* = If = M0)(i - r), 1 F = 1f( 0), P = r, P + =p, P - = q, Pt = (rp), 

r(x) = r 0 (x), r_(x) = r_i(x), r+(x) = Ti(x), r = (x) = r_ 2 (x), r t (x) = r 2 (x), 

K(x, y) = K 0 (x,y), K(x,y) = K 0 (x,y). 

For simplifying the forthcoming results, we will only consider the cases where F = Z and F = {0}. In the case 
F = Z, we have Gi(x) = 1/(1 — x) for any integer i and 

G(x) = G+(x) = G_(x) = jl—, G t (x) = (J) , 

while in the case F = {0}, we have Gi(x) = F_i(x) for any integer i and 

G(x)=r 0 (x), G_(x) = F 1 (x), G+(x) = F_ 1 (x), G t (x) = ■ 

Theorem 14.31 provides the result below. 

Theorem 5.1 Set A(u) = (1 — ru) 2 — Apqu 2 . The generating function Kq admits the following expression: 

• «/ F = Z, 

j, t N (p - <i)( x - y) + (! - y)V A ( x ) + (f - x )V A (v) , c ^ 

ivn(x, y) = y - 1 — . - . —; (5.1) 

(i - *)(i -y)(y-x + y\ZA{x) + x^A( y )) 
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if F — {0}, 


K 0 {x,y) = 


2 y 


y-x + yyj A(x) + xy/A(y) 


(5.2) 


Proof 

Observe that r_i(x)/r 0 (x) = z(x) and Id (:r)/r 0 (x) = l/£(x) =pz(x)/q. 


In the case where F = Z, in view of (I4.15|) . we see that K 0 (x, y) can be written as N(x, y)/D(x, y) where 

(1 - x)(l - y)N(x,y) = (1 -y)(l - rx-pxz(x))( 1 - z(x)) 

+ (1 - x)(l - (p + r)y - py z(y)) - (1 - x)(l - y), 

D{x , y) = 1 — rx — px z(x) — px z(y). 

Using the identity px z(x) 2 = (1 — rx)z(x) — qx, straightforward computations lead to 

2(1 - x)(l - y)N(x,y) = 2(l - (q + r)x - (p + r)y + rxy - px( 1 - y)z(x) - py(l - x)z(y)) 

= (P~ q)(x - y) + (1 - y)y/A(x) + (1 - x)y/A(y), 

2y D(x, y) = y - x + yyj A (a;) + xyj A(y). 

We immediately deduce (15.11) . 


• In the case where F = {0}, by (14.151) . K 0 (x,y) can be written as N(x,y)/D(x,y) where D(x,y) has 
exactly the same expression as previously and 


N(x, y) = (l -rx- px z(x)) (l - J - z(x) 2 ^ + (l -ry- 2 py z{y )) - 1. 

Thanks to px z{x) 2 = (1 — rx)z{x) — qx , elementary computations give 

(l — rx — px z(x )) ^1 — — z{x) 2S j = (l — rx — pxz(x )) (2 qx — (1 — rx)z(x)) = y/ A(x), 
1 -ry- 2 py z(y) = y/ A (y), 
so that N(x,y) = 1 from which we extract (15.21) . 


□ 


Proposition 5.1 For F = Z, the following identity holds true: 

K 0 (x,y) = K 0 (x,0)K 0 (0,y). 


(5.3) 


Proof _ _ _ 

Putting x = 0 or y — > 0 into (EH) and observing that y — x + y\JA(x) + Xy/ A(y) y(l — rx + V A ( x )) 

entail that 


ts , 1 ~ ( 2| ? + r ) x + y/ A ( x ) j T s m ^ 1 - ( 2 P + r )v + V A (.y) 

Ko(x,0) = — - — - V-— and K o (0,y) = — 


(1 — x)(l — rx + y/A(x )) 
By elementary calculations, we see that 


2(1 -y) 


((2 p + r)x - 1 + y/ A(x)) (l - rx + \JA{x )) = 2px(l - (2 q + r)x + y/ A(x )) 
and -Ko(a;,0) can be simplified into 


Ko{x, 0 ) = 


(2 p + r)x - 1 + y/A{x) 


2px{\ — x) 

Therefore, the product of the two terms K 0 (x, 0) and K o (0, y) is given by 


K o (x,0)K o (0,y) = 


((2 p + r)x - 1 + y/A(x))(l - (2 p + r)y + y/A(y)) 


4px(l — x)(l — y) 

Straightforward but tedious computations that we do not report here show that 


(5.4) 


((2 p + r)x- 1 + y/A(x) ) (1 - (2 p + r)y + yj A(y) )(y-x + yy/ A(x) + xsj A (y )) 
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= 4 pxy((p - q)(x - y) + (1 - y)y/A(x) + (1 - x)^ A(y)). 

Finally, comparing m and (15.411 ensures the validity of (15.311 . □ 

Decomposition (15.31) may be appropriate for inverting the generating function Kq in order to provide a closed 
form for the probability distribution of T n . We will not go further in this direction. 

Concerning Kq, for * = 0, we introduce the following settings: 

A(x, y) = (1 — rx)( 1 — ry) ^2(1 — r)(l — qx — py — rxy) 

- — (4 ~ y)(r{l - rx) 2 + (1 - r) 2 px ) - — (1 - x)(r( 1 - ry) 2 + (1 - r) 2 qy )), 

px qy / 

B(x,y) = — (1 - y){ 1 - ry)(r{ 1 - rx) 2 + (1 - r) 2 px), 

C{x,y) = ^ (1 - x)(l - rx)(r( 1 - ry) 2 + (1 - r) 2 qy). 

The quantity A(x, y) admits the following expansion: 


( x y 1 1 \ 

anxy + a w x + a m y + ai_i- + a_n- - a_i 0 -a 0 _i- + a 00 , 

y x x y J 

where the coefficients o^- (of x L y^) are expressed by means of p, g, r as follows: by substituting p + q = 1 — r, 

«„ = — + — + 2r*- 2r = 2r(l - r) (A - 2 ) , 

p q \pq ) 

a 10 = - — + (1 - r) 2 - 2q(l - r) = -r 2 (- + -) + (p - ?)(1 - r), 

p q \p qj 

aoi = --— + (1 - r) 2 - 2p(l - r) = - r 2 (- + -)+ (g - p)(l - r), 

q p \q pJ 

aoo = —— + —— — 2r 2 + 2r = 2r(l — r) (— + d , 

p q \pq J 

r r r r 

0-10 = —, ao-i =-, Oi_i = 0-11 = —■ 

p q q p 

We also introduce 

A'(x, y) = ( 1 - rx){ 1 - ry) ^(l - 2r - r 2 ) + r + r ^ 2 p qy 2 ) ’ 

B'(x, y) = - ——(pg(l - r)x 2 + (1 - rx) 2 ), 
pqx z 

C'(x, y) = - ——^ (pq( 1 - r)y 2 + (1 - ry) 2 ). 

pqyi 

Theorem 14.31 provides the result below. 

Theorem 5.2 The generating function Kq admits the following expression: 

• if F = Z, 


£ , n 1 _ ^(x, y) + ff(s, y) ^A(x) + C(x, y) yjA{y) __ 

° (1 - x)(l - y) 2r(l - rx)(l - ry) + (1 - r)((l - ry)yjA(x) + (1 - rx)yjA{y)) 

• ifF = { 0}, 

K , n _ A'(x,i/)+5 / (x,i/)A/A(x) + C , '(x,y)A/A(i/) _ 

° ,V 2r(l - rx)(l - ry) + (1 - r)((l - ry)sjA(x) + (1 - rx)^JA{y)) 

Proof 


(5.5) 


(5.6) 
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In the case where F = Z, in view of (I4.16|l . we see that K 0 (x,y) can be written as N(x,y)/D(x,y) where 


N(x,y) = ( 


= 1 - 


1 — r 
1 — rx ‘ 


px z(x) ) ((1 - r) + PX (l - z(x) 


/ 1 - r 

+ 11 - -- pyz 

V 1 — ry 


1 — x 

qy 


l-r) + T ^- y (l-^z(yf))-(l-r), 


~ 1 — r 1 — r 

D(x,y) = 1 - - pxz{x) - - -— py z{y). 


1 — rx 


1 ~ry' 


Using the identity px z(x) 2 = (1 — rx)z(x) — qx, we easily get that 

(1 - x)(l - y)( 1 - rx)( 1 - ry)N(x , y) 

= (1 — y){ 1 — ry)(l — rx — (1 — r)px z(x)) ((1 — r) — (1 — rx)z(x)) 

+ (1 - z)(l - rx)( 1 -ry - (1 - r)pyz(y)) ((1 - r) - ^(1 - ry)z 

- (1 - r)(l - a:)(l - y)( 1 - rx)( 1 - ry), 

(1 - rx)( 1 - ry)D(x,y) 

= (1 — rx)( 1 — ry) — (1 — r)(l — ry)px z(x) — (1 — r)(l — rx)py z(y). 
Straightforward computations lead to 


2(1 -x)(l- y)( 1 - rx)( 1 - ry)N(x, y) = A(x, y) + B(x, y)yjA(x) + C(x, y)yj A(y), 

2(1 - rx)( 1 - ry)D(x,y) = 2r(l - rx)(l - ry) + (1 - r)((l - ry)\JA(x) + (1 - rx)^J A (yj), 
from which we deduce (15.51) . 

• In the case where F = {0}, by (14.161) . K 0 (x,y) can be written as N(x,y)/D(x,y) where D(x,y) has 
exactly the same expression as previously and 


N(x,y) = ( 


1 — r 

= ( 1 — -- px z 


1 — rx' 

1 — r 


0-T 


ry 


+ TzmO-;*«’)]-e-) 


■pyz 


VW) 

By replacing z(x) by its expression, elementary computations give 


1 1 - r \ i pxz(x) ( p 2 

1- pxz(x)\ (1 — r) + 11 

1 — rx J L 


\jA(x , 

so that N(x,y) = 1 from which we extract (15.61) . 




1 2 , (! -rx) 2 


2 pqx 2 


r /1 — rx 1 — r 


:( 


2 V pqx 2 1 — rx 


)VaR 


□ 


In the case where r = 0 (and p + q = 1), that is, when the random walk does not stay at its current location, 
the generating function Kq can be simplified. We write its expression below. 


Corollary 5.1 In the case where r = 0, we have A(x) = \J 1 — 4 pqx 2 and the generating function Kq is given 
by 

• if F = Z, 


Ko (x,y) = 


ifF = { 0}, 


(p - q)(x -y) + ( 1 - y) y/A(x) + (1 - x) s /A(y) _ 
(1 - x)(l - y)(y/A(x) + V A (?/)) 

K 0 (x,y) = 


\/A(x) + \/A(y) 


We retrieve the expressions obtained in PH; especially in the case where F = Z, the corresponding expression 
is rewritten in the form 


K 0 (x,y) 


I 


v/A(x) + y/A(y) 


P - Q + V A(ar) g - p + VA(y) ^ 


1 — x 


1-2/ / 


which can be inverted in order to provide a closed form for the probability distribution of T n (see }14]h 
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6 Symmetric random walk 

In this part, we focus on the particular random walks satisfying L = R = M, with steps lying in {— M, —M + 
1 ,,M — 1 , M}, such that 7 = 7r_j for all integer i. In this case, the random walk (X m ) m6 N is symmetric. 
We provide a representation of the generating function of r° which can be inserted into the matrices introduced 
in Section U 


6.1 Generating function of X 

The polynomial P x takes the form 


P x (z) 



M 

— TTqX — X 7 Tj 

7=1 




To simplify the discussion, we will suppose throughout Section [6] that all the roots of P x are distinct. 

We immediately see that its roots are inverse two by two so that the sets C + and C~ have the same cardinality 
M. It is clear that there are M roots of modulus less than one, while their M inverses have modulus greater 
than one. So, we relabel the roots as ze(x) and zi+m{x) = l/zg(x), I £ (1, ... ,M} with the convention that 
\ze(x)\ < 1. This yields C~ = {1,..., M} and C + = {M + 1,..., 2M}. 

Because of the equality P x (z) = z 2M P x (l/z), we have P x (z) = 2 Mz 2M ~ 1 P x {1/z) — z 2M ~ 2 P x (l/z ) and this 
implies that 

. (1 /ztjx))**- 1 

p U z d x )) p !A l /zt{x)) 

Therefore, expressions (14.41) of Tj_i(a;) can be simplified and we get the generating function of X which is 
displayed below. 


Proposition 6.1 

x £ (0,1), with 


The generating function of X is characterized by the numbers Gij (x) 


M 


T j-i(x) = J2 = 3} = z ^ jl 


m—0 


p L{zi{ x )) 


Below, we give three examples of such random walks. 


Tj-i(x), i,j e z, 

( 6 . 1 ) 


Example 6.1 Let us consider the random walk with jump probabilities given by 

2 M 


7 Ti= C 


M 


for i £ {-M, -M + 1,..., -1,1,..., M - 1, M}, 


7T 0 = 1 - c 


4 m _ 


2 M 
M 


where c is a positive constant such that c < 1/[4 M — ( 2 ^)]. For c = 1/4 M , we have 7T; = for any 

i £ {—M, — M + 1,M — l,M} and for c = 1/ [4 M — ( 2 ^)], we have 7To = 0, that is, the walker never stays 
at its current position. 

In this case, 

= - V M ( c (y + !) 2M + (! - c4 M ) y M ), 

and M 

G( x ,y) = -^— where P x {z) = (l - (1 - c4 M ) x)z M - cx(z + 1) 2M . 

p x{y) 

Suppose that x £ (0,1). The roots of P x are those of the M quadratic equations 


(z + l) 2 -e^J 1 t 1 cAM ) x z = o, 0 < r < M — 1. 

V cx 

We have that 

P' x { Zl {x)) =M(1- (l-c4 M )x)zt{x) M - 1 -2Mcx{z t {x) + l) 2M - 1 = M(l - (l-c4 M )x) zt{x) M ~ l . 

Expression nn\) takes the form 


Tj-i(z) 


1 

M (1 - (1 - c4 M ) x) 


M 


E 


1 + ze(x) 
1 - zt(x) 


zt{x)\ l j| . 
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Example 6.2 Let us consider the random walk with jump probabilities given by 


jm =cpM^J fori£ {—M, —M + 1,..., — 1,1,..., M — 1, M}, 

l 7T 0 = 1 — 2 C ((p+ 1) M - l), 

where c and p are positive constants such that c < 1/(2 (p + 1) M — l). For c = l/(2(p+ 1) M — l), we have 
7Tq = 0, that is, the walker never stays at its current position. 

In this case, 

®(v Ul ) = c((py + 1 ) M + (J +1) - 2 (P + !) m ) + !. 

and 

G {x,y) = ^_ where P X ( Z )= [l~(l-2c(p+l) M )x\z M -cx[{pz 2 + z) M + (z + p) M ]. 

Example 6.3 Let us consider the random walk with jump probabilities given by 

( 7Tj = c for i £ {—M, —M + 1,..., —1,1,... ,M — 1, M}, 


7Tq = 1 — 2 Me, 


where c is a positive constant such that c < 1/(2M). This is a random walk to the 2 M nearest neighbours with 
identically distributed jumps and a possible stay at the current position. For c = 1/(2 M), we have ng = 0, that 
is, the walker never stays at its current position. For c = 1/(2 M + 1), each step put the walker to the 2 M 
nearest neighbours or let it at its current position with identical probability. 

In this case, 

and 

n M 1 

G(x,y) = p where P x (z) = : [(l - (1 - (2 M + 1 )c)x)(z M - z M+1 ) - cx( 1 - z 2M+1 )]. 


6.2 Symmetric (2, 2)-random walk 

In Example 14.11 we have considered the case of non-symmetric (2, 2)-random walk. Now we have a look on 
the symmetric (2, 2)-random walk (corresponding to the case M — 2) which is characterized by the three 
non-negative numbers 7ro,7Ti,7r 2 such that 7 Tq + 27Ti + 2-7T2 = 1: 


7T 0 = P{£/l = 0}, 7T 1 =P{f/ 1 = l}=P{[/l = -l}, 7T 2 =P{C/ 1 =2}=P{[/ 1 = -2}. 


We have that 

E( y Ul ) = tt 2 (y 2 + + 7Ti (^y + + tt 0 

and G(x,y ) = y 2 / P x (y ) where 

P x (z) = Z 2 - X (7 r 2 Z 4 + TTlZ 3 + TT 0 Z 2 + 7Tl2 + 7T 2 ) = z 2 


l- x[ n 2 \ z + ) + tti[ z + - ) + TT 0 


Set S(x) = (7Ti +47r 2 ) 2 + 47t 2 (1/x — 1). The roots of the polynomial P x can be explicitly calculated by introducing 
the intermediate unknown ( = z + 1/z and solving two quadratic equations. For x £ (0,1), the roots are real 
and distinct, those of absolute value less than 1 are given by 


z\ (x) = — ^7Ti — \JS(x) + V2 + 47Ti7t 2 — 27t 2 -I— -f- — tti \J5(x^J . 

^7Ti + \/S(x) + V 2 + 47Ti7r 2 - 27 t 2 + + Tt\ yj 6(x)^ , 


( 6 . 2 ) 


Z2{x) = - 
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and the other ones are Zq(x) = l/z\(x) and Zi(x) = 1 /z 2 {x). Moreover, rewriting P x as P x (z) = z 2 Q x (z + 1 /z) 
with Q X (C) = 1 — x (7t 2 C 2 + 7Ti£ + 7r 0 — 27 t 2 — 1/a;) , we get that if z is a root of P x , then 

P x (z) = (z 2 - l) Q' ^2 + ^ = x (l - z 2 ) ^27r 2 ^z + ^ + 7Ti^ 

which can be simplified into 

K{z\{x)) = X (1 - Z^x) 2 ) y/5{x), P x (z 2 (x)) = -x (l - Z 2 (x) 2 ) ^/6{x). 

Identity (16.11) yields the generating function of X below. 

Proposition 6.2 The generating function of X is characterized by the numbers Gij(x) = Fj-i(x), i,j £ Z, 
x £ (0,1), with 

r / \ __ 1 ( Zi _ g2 (a;)IJ-*l+ 1 \ 

J ~ l[ ’ X^/m { 1 - Zl(x) 2 1 - Z 2 (x)l j 

where z±(x) and z 2 (x) are displayed in 

Finally, we provide a representation of the generating functions of sojourn times T n and T n in the case where 
F = Z. We apply Formulas (14.151) and (14.161) with M = 2 and F = Z. 

Theorem 6.1 The generating matrices of T n and T n admit the respective representations 

K(z, y) = D(z, y)~ 1 N(x, y) and K(x, y) = D(a;, y) _1 N(x, y) 

where D(x, y)^ 1 , N(x, y) are given by |7. 11\ ) - \7.12\) further and D (x, y )-\N(x,y) h rrm-rrm. 

The explicit expressions of matrices K(a;,y) and K(a :,y) involving cumbersome computations, we postpone the 
proof of Theorem 16.11 to Subsection 17.51 

7 Proofs of Theorem 13.1L Theorem 13.21 and Theorem 16.1 

In this section we give the proofs of Theorem l3.ll Theorem 13.21 and all the auxiliary results stated in Sections [2] 
and[3]as well as the proof of Theorem l6.ll Subsections 17.II and !7. 21 concern time T n while Subsections l7.3l and l7.4l 
concern time T n ; Subsection 17.51 concerns the case of (2, 2)-symmetric random walk. 

7.1 Proof of Theorem 13.11 

We first observe that for n £ N*, 

• T n = 0 if and only if for all m £ {1,..., n}, X m £ E ~, that is if and only if t' > n; 

• T n = n if and only if for all m £ {1,..., n}, X m £ E\ that is if and only if t~ > n\ 

• l < T n < n — l if and only if there exists distinct integers £,£' £ {l,...,n} such that Xg £ and 
Xgi £ E~. This is equivalent to saying that t~ < n and t' < n. 

In the last case, we have the three possibilities below: 

• if Xq £ E ~, then r° = -p < n by Assumption (Ai); 

• if Xq £ E + , then r° < t~ — 1 < n — 1 by Assumption (A 2 ); 

• if Xq £ E °, the following possibilities occur: 

— if Ad £ E°, then r° = 1; 

— if Ad £ E + 1 then r° < t~ — 1. In this case, r° is the return time to E°\ 

— if Ad £ E ~, then r° = r'. In this case, r° is the return time to E°. 

This discussion entails, for any i £ £, that 

P i{T n = 0, X n £ F} = Pi{r t > n, X n £ F} = P,;{X„ £ P} - P^t 1, < n, X n £ F} 

n 

= Fi{X n eF}-J2 = e, Xn £ F}. 

£=1 
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From this, we deduce the following: 


Ki{ 0 , y)=Y = °> x n£ F} V n 

n —0 

oo oo n 

= ^ !*,{ S F} J," - ^ ^ p,{ T t = f, e F} J," 


n—0 


n—1£=1 


oo oo 


= E E p *{ x -= j} y n - E E E p ^ = = j} G f} -if 

j€.F\n =0 / fcln=lj£Et 


, n—0 


= E G d(y)- E E p *{ Tt = ^ x - += j}^)( E p ^ x « e w 

je.F j£Et \£=i 

= Gi(y) - Y H Uv)Gj(y)- 

jest 


This proves the second equality in (13.121) . In a very similar way, 

n 

P i{T n = n, X n G F} = P ;{t~ >n,I„GF} = Pi{X n G F} - ^P^r" =l 1 X n € F}. 
This entails that 


fci 


ifi(®,0) = £P 4 {T n = ri, X n G F} a; n = G^z) - ^ H~ j (x)Gj(x) 

n=0 j&E~ 

which proves the first equality in (13.121) . Next, we compute Ki{x , y): 

OO OO 

2/) = E P ^ T « = n, X n G F} x n + Y Pi{T n = 0, X n G F} y" - P 4 {X 0 G F} 


n—0 


n=0 


+ ]T P i {T n = rn,X„GF} a : m y n - m 


m,n£N: 

l<m<n-l 


= Ki(x, 0) + Fj(0, y) + Y Pi{ T ° <n,T n = to, X n G F} x m y n ~ m — t F (i). (7.1) 


m,neN: 

l<m<7i —1 


We observe that on the set {r° < n} 

n n n—T° 

Tn = 'Y, l_Et(X m ) = T t o + 'Y ^-El( X m) = T t o + l.Et (X m+T o) = T t o + T^_].o 

m= 1 m=r°+l m=l 

where T^, T _^„ is the sojourn time in F^ up to time n — r° for the shifted chain (X m+T °) me N- Moreover, 

• if Xi G E\ we have Xi,.... X T o g Ft and then T t o = r° which yields T^_]. 0 =T n — r° ; 

• if Xi G E~, we have Xi,... ,X T o_x G F _ ,X r o G F°; in this case F r o = 1 and then T^_\ a = T n — 1. 
Consequently, for to G {1,..., n — 1} and i G S, 

P 1 {t° < n, T n = to, X„ G F} = Pi{Xi G F f , r° < n, T n = to, X n G F} 

+ Pi{Xi G F , r° < n, T n = m, X„ G F} 

n—1 

= E E p ^ Xl e Et > T ° = 4= j}Pj{r n _/ = m-e,x n _ e g f> 

j(zE° £=1 

n 

+ EE P ^ Xl e F-, r° = £, X r o = j} P,{T„_* = TO - 1, X n _^ G F}. 

jeE° 1=2 

The sum in (O) can be evaluated as follows: 

Y P ^ T ° < n ’ T n = m > € F} X m y n ~ m 

m,ne N: 


22 






= E E e Et > T ° = X -° = 3} E r j{ T n-e = m-l, X n _ t £ F} 

£=1 j'G-E° 


x rn y n m 


m,neN: 
■£<m<ra —1 


+ E 51 P,{x 1 er 1 r°=aT»=i} 

£=2 jG-E° 


m.nGN: 
l<m<n-£ + l 


= EE P ‘{ X i&E\t° =t,X T o=j}x l 55 P j {T n = m,X n £F} 

jeE° i=\ 


x my n -m 


n,nGN: 
n<n-1 


55 55 P,{X! sr,T°=<, X T o = 3 } xy*- 1 55 P j{T n = m,X n £F} 

j£E° e=2 m,n£N: 


A""" 


= E E i( xT ° 1 {x 1 eEi,x T o=j})[Kj(x,y) - Kj(x,0)] + ^ E E i(2/ T °l{XieJi;- 1 x T o=j})^(^ I 2/) 


jeE° 


j£E° 


= E + -r H °j (y)) K j( x ^y)- E ff S f ( x )- K j( a: > 0 )- 

i'C RO \ y / d£= Ro 


(7.2) 


j£E» v a / jGE o 

As a result, putting (17.211 into (17.Ill , we get (13.111) . □ 

7.2 Proof of Proposition 13.11 

By putting (13.121) into (13.111) . we obtain, for all i £ £, that 

K i (x,y) = G i (x)~ E Hr.{ x )G j {x)+G i (y)- E H^Gjiy)- E H?}{x)G j {x) - l F (i) 


jeE- 


jeE t 


je£° 


+ E (*) + Z H°~^) K ^y) + E H °ki x ) E H kji x ) G A x )- (7.3) 

jeE° ' y J keE° j£E- 

If i £ E + , we have (y) = pij y, H°j(x) = H°^(x), and H°~(y) = 0. Putting this into (17.31) . we get that 

Ki{x,y) = Gi(x) - E H ij( x ) G i ( x ) + E H °j( x ) K i( x ’y) 


j£E° 


j£E° 


+ E ( E H °k(*)Hv(x) - H^j(x) j Gj (x) + ( G,(y) - y E P«^(j/) - M*) )• (7.4) 

jeE- \ k&E° J \ jest / 

We claim that both terms within brackets in the second line of m vanish. Indeed, for j £ E , since r° < r , 
we have that 

H~ j {x)=E i (x T 1 { x T -=j})= E E *E°l{x T o=fc})Efc(a; T 1 { x r _=j}) = E H ik( x ) H kj( x )- 

keE° keE° 

Therefore, the first term within brackets in the second line of (d vanishes. Moreover, by (E2D. we have that 

G i{y) = E G ik(y) = E + y E Pv G ik(y) j = 2/ E Pb G j(y) + M*) 

fcef feeF \ jest / jeFt 

which proves that the second term within brackets in (17.41) vanishes too. Hence we have checked that (13.131) 
holds true. 

On the other hand, for i £ E ~, we have necessarily r° = and then hY( y) = H°^{y) 1 Moreover, if 

i £ E~ and X\ £ E\ then r° = 1 and Xi £ E° and we have that 

H$(x) =PijXl E o(j), H?r(y) =E. l (y T l {Xr0=j} ) -E t (y T l {XlGE i X ^ 0=j} ) = H^{y) - p^ y l E o(j). 

Then, putting these equalities into (17.31) . we get that 

Ki(x,y) = Gi(y) - E H °M G M + “ E H° 0 {y)K 3 ( Xl y) 


J&E° 


j£E° 


+ (G i {x)-x^2p ij Gj(x)-l F (i)\+ E [ x E Pik H kj( x ) ~ HijixUGjix). (7.5) 
V j&E° J jeE- \ keE° J 
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We claim that the sum of both terms within brackets in the second line of <E3 vanish. This can be easily seen 
by using (13.21) and Assumption (Ai) which yield that 

Gi(x) - x ^2 pijGj(x) - 1 F (i) = x ^2 pijGj(x) 

jeE° j<=E- 

and by observing that 

H~.{x) = E,(a; r 1 { Xi ge-, x r _=j}) + E*( x T t{ Xl eE°,x T _=j}) = x ^ PikHjfj (x) + Pij x 1 E - (j). 

k£E° 

Finally, Equality (17.51) can be simplified to (13.141) . □ 

7.3 Proof of Proposition 12.11 

Set A^ m = {X m £ E°}. We notice that for any m £ N* and any £ £ {1,...,to}, A^ m = Aj} m D A^_ 
Therefore, putting this into the definition of B m , we get, for any ra£ N*, that 

Bm — A 0jm U A\ m U • • • U A rn —i rn 

= Ao, m U (Ag m D Ao, m _i) U • ■ • U (Ag m D A to _2, to -i) 

= Ao, m U [Ag m D (Ao, m _i U • • ■ U A m _2, m -i)] 

and we see, for any to £ N\{0,1}, that 

B m = A 0 , m U (A° m D B m _i). (7.6) 

In the same way, we have that 

B'm = A^ m u(A^ m nB' rn _ 1 ). (7.7) 

By observing that (Ag m ) c D Ag m = A' 0 m and using the elementary equality A U B = A U ( B\A ), we obtain 
from (17.61) that 

B m = A 0,m n ((Ao, m ) C U B^_i) 

= ((^o,m) C n Ao im ) u (Ag m D B^-2 

= A),nx ^ [(A },m ^ B m- 1) \A),m] • 

The term within brackets in the foregoing equality can be simplified as follows: 

(A>,m ^ B m- 1) \A),m = (A),m\A),m) bl B!f l _ 1 = Aq m D Bf n _ 1 . 

As a by-product, for any m £ N*, 

5™ = A' m u(A“ m n^_ 1 ). (7.8) 

Now, in view of (EZD and m , it is clear by recurrence that B^ = B' m as claimed. □ 

7.4 Proof of Theorem 13.21 

The observations below will be useful to compute the generating function of T n . 

Lemma 7.1 Assume that Xq £ E°. The following hold true: for any n £ N*, 

• T n = 0 if and only if t + > n; 

• T n = n if and only if X\ £ E + and t~ > n; 

• if 1 < T n < n — 1, then f± <n and T n = — 1)1 E + +Tf where Tf = X^m=f± ^m• Additionally, T’ n has 

the same distribution as T n _f± + i and is independent from X \,..., X?±_i. 

Proof 

Fix a positive integer n. 

• Concerning the first point, we have that 

— the set {X \,..., X m £ E~ U E°} is included in B' m for all m £ {1,..., n}. Then, if X m £ E~ U E° 
for all to £ {1 ,...,n}, we have 8\ = • • • = S n = 0 and T n = 0; 
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— if there existed an £ £ {1,..., n} such that Xg £ E + , we would have of course T n > 1. 

This is equivalent to saying that t + > n. 

• Concerning the second point, we have that 

— the set {Xi £ F + ,A 2 ,...,X m £ E + U E°} is included in B m for all m £ {l,...,n}. Then, if 
X\ £ E + and X 2 , ■ ■ ., X n £ E + U E °, we have S± = ■ ■ ■ = S n = 1 and T n = n; 

— if there existed an £ £ {2,..., n} such that Xu £ E~ , we would have of course T n < n — 1. If we had 
X\ £ F _ U F°, we would have <5i = 0 and T n < n — 1 too. 

This is equivalent to saying that X\ £ E + and t~ > n. 

• Concerning the third point, we have that 

— l<T n <n—lif and only if there exists distinct integers £,£' £ {1,... ,n} such that Sg = 1 and 
6g> = 0. This implies that there exists necessarily an integer to £ {1 ,... ,n} such that X m £ E°. 
Else, because of Assumptions ( A \) and (A 2 ), we would have X m £ E + for all to £ {l,...,n} or 
X m £ E~ for all to £ {1,..., n}; in both cases, we would have T n £ {0, n}. Therefore 1 < t° < n. 

— On the other hand, we must take care of the successive points lying in E° after time r°. For describing 
them, time f± will be useful. Obviously, we have f ± > r° > 1 and between times r° and — 1, 
the chain (A ra ) n6 N stays in E°. More precisely, we must take care of the points corresponding to 
the times between r° and (f ± — 1) A n. In fact, these (f ± — 1) A n — r° points are counted in T n if 
Xi £ E + , not counted if Ai £ E~ U E°. Then, if < n, we have T n = T f ±_ 1 + T' n with 


T f ±_ 1 = 



1 if X 1 £ F+, 
if X x £ E~ U E°, 


and T' n 


n 

E s - 

m—f ^ 


□ 


Now, we prove Theorem 13.21 The points displayed in Lemma 1770 entail that, for i £ E° and for n £ N*, 
PijA! £ E ± ,T n = 0,A n £ F} = P l {X 1 £ E~,t+ > n,A„ £ F} 

= E Pij^j{ T+ >TI- l,X n _i £ F}, 

- JGE ~ (7.9) 

P^A, £ E ± , T n = n, X n £ F} = P^A, £ E+, t ~ > n, A„ £ F} 

= E Pij p jl T ~ >n - 1, X n -i £ F}, 

j£E+ 

and for i £ E° and m £ {1,..., n — 1}, 

n 

Pi {Ad £ E ± , f n = to, X n £ F} = p i(*i e E ± , f ± = e, A f ±_! = j, T n = to, A„ £ F} (7.10) 

e=2jeE° 

where, for £ £ {2,..., n}, 

P,{Ai £ E ± ,f ± = £,X f ±_ 1 = j,T n = m, A n £ F} 

= Pi{A! £ F+,7 ± =e,X f ±_ 1 = j}Pj{Xi £ =m-£+l,X n _ e+1 £ F} 

+ Pj{Ai £ E , = £, Xf±_i = j} Pj{Xi £ E±, T n -g + i = to, £ F}. 

By (17.91) and by imitating the proof of (13.121) . it can be easily seen that K t (x, 0) and Ki(0,y) can be written 
as (13.201) . Next, we compute Ki(x,y). By (17.101) . 


Ki(x, y) = Ki(x, 0) + Ki{ 0, y) - P^Aq £ F, A, £ E ± } + E &E ± 1 f n = m,X n £ F} x m y n - m 

m,ne N: 

l<m<n —1 

= Ki(x, 0) + Ki(0,y) - l F (i)P l {A 1 £ F±} 

OO 

+ E E MXi&E+,f ± =£,X f± _ 1 =j} 

t=2 jeE° 
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X 


^ P^X! G E ± ,T n _ e+1 =m-t + l, X n _e +1 G F} x m y n - m 

m.TxGN: 
t— l<m<n — 1 

OO 

+EE Pijx, G^r.f* =^,x f± _ 1 =i} 

t—2jeE° 

x ^ PjIX, g E ± ,T n _ e+ 1 = m,X„_, +1 e F}x"V m 

m,n 6 N: 
l<m<n —^+1 

= ^i(®,0) + X*(0,y) - l^P^Xi g F±} 

OO 

+EE P^Xi G E+, f ± = £, X f± _i = j} y) - X,(x, 0)) 

^=2 j£E° 
oo 

+EE Pi{Xi GE~,t ± = £,X f± _! = jl^X^y) - Xj(0, y)) 

£=2 j£E° 

= Ki(x,0)+Ki(0,y)+ Y {H± + ( x ) + H±-{y))Kj{x,y) 

j£E° 

- Y 0) - Y Ht~(.y)KMy) - MW*! g e±}, 

j£E° jGE° 


as claimed. □ 


7.5 Proof of Theorem 16.11 

• First step: writing out the matrices 

Suppose F = Z and set zu = 7Ti + 27r2, 1 = 


fl\ „ 

(A 

i 

(l> 1= 

i 


W 


. Below, we rewrite the matrices displayed in 


Example 14.11 which can be simplified under the condition of symmetry 7r_i = 7Ti, 7 t_ 2 = 7T2 and F_j = Fj 
for any integer j: 

T 0 N 


I = 


P = 


7 Tq 7 Ti 
7 Tl 7 T 0 


P_ = 


0 1 J’ 

7 T 2 7 Ti 

0 7 T 2 


I 1 * 1 = rol, If = 1, lp = zul, 


P+ = 


7 T 2 0 

JZl 7 T 2 

tv t \ _ / r o(a?) ri(a;)\ , , _ (T 2 (x) ri(®) 

L[X) -{r 1 (x) To(x)J’ L - [X, -\T 3 (x) T 2 (x) 


7 T 0 7 Ti 7 T 2 0 

7Tl TTO 7r l 7T2 


r+(*) = 


r2(a:) r 3 (x) 

ri(a;) T 2 (x)J' 


T M _ fr 4 (x) r 3 (x)\ , , _ fr 4 (x) r 5 (a:)\ 

L=[X) - \r 5 (x) r 4 (x)J ’ r^®)/ 


G(®)=G+(®) = G_(®) = --1, G t (x) = --1, 

1 — x 1 — X 

K (x,y) = 


( K 0 (x,y) 
\Ki(x,y) 




We observe that P and r(x) are symmetric and that P+, r+(x), rj(x) are the transposes of P_, r_(x), 
r = (x), respectively. Let us write the inverses of r(a:) and I — x P. For this, we introduce their respective 
determinants: 


S(x) = (7Tq - e[)x - 2 -kqX + 1, A(x) = r 0 (x) - Ti(x) . 


We have 


"(a:) -1 = aTT ( F r^\ rV?)’ ( I_;rP )” 1 = Ar 

v ; A(®) \-Fi{x) r 0 (x) J’ v ' <5(a 


1 — 7 TqX 7 TlX 

x) V E\X 1 - tt 0 xJ' 


• Second step: deriving the generating matrix K 

In view of (14.151) . we write K(x,y) as K(x, y) = D(x, y) _1 N(x, y) where 


D (x,y) =I-x(P + D + 0) + D_(y)) 
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N (x,y) = [I - x(P + D_|_(x))]N_(a;) + -L- N t (y) - 1 
ix i y 

with 

D+(*) = P+r_(x)r(a;) _1 , D_(y) = P_T + (y)T(y)-\ 

N_(s) = 1 - r_(a:)r(a:) _1 l, N t (y) = l-j/P t l - j/D_(y)l. 

First, we calculate 

, - _ i f 7T2 oVr 2 (i) Fi^V r 0 (i) -r i (a;) > \ 1 ( D m( x ) D oi( x )\ 

+ X _ A(x) Vri 7r 2 yVr 3 (a;) T 2 {x)Jy-T^x) r 0 (a;) J A(x) \D+ 0 (x) D+^x)) 

with 

D+(x) = 7r 2 (r 0 ( 2 ^ 2 ( 2 ;) - Ti( 2 ;) 2 ) 

Dqi( x ) = 7T2(r 0 (2;)ri(2;) - ri(x)r 2 (a;)), 

-Di“o 0*0 = 7Ti(r 0 (2;)r 2 (2;) - Ti( 2;) 2 ) + ^(A^lMaO - Id ( 2 :)]^ ( 2 :)), 

£>U( 2 ;) = 7Ti(r 0 (x)ri(2;) - ri(2;)r 2 (x)) + 7r 2 (r 0 (2;)r 2 (2;) - Fi( 2 ;)r 3 ( 2 ;)). 

Similarly, 

n (:,) _ 1 A 2 7r iV r 2 (y) r 3(y)V r 0 (j/) -iMyA = 1 f D oo(y) d 01 (y)\ 

A(y)\0 TT 2 J\ri{y) T 2 {y)J\-T 1 (y) T 0 (y) J A{y) \D^ 0 (y) D^(y)J 

with 

D oo (y) = 7n(r 0 (y)ri(tf)-ri(i,)r 2 (y)) + 7r 2 (r 0 (y)r 2 (y) -ri(y)r 3 (y)), 

£>01 (y) = 7r i( r o(y)r 2 (y) - iMy) 2 ) + 7r 2 (r 0 (y)r 3 (?/) - ri(y)r 2 (y)), 

■°ro(y) = 7T2(r 0 (2/)ri(y) - ri(y)r 2 (y)), 

Dfi(y) = 7T2(r 0 (2/)r 2 (y) - ri(y) 2 ). 

With this at hand, 

,a-i _ A 0*0 A (y) Al - Tr 0 x)A(x)A(y) - xA(y)D+ 1 (x) - yA^D^y) 

£>( 2 ;, y) V TT 1 xA(x)A(y) + xA(y)D+ 0 (x) + yA(x)D^ 0 (y) 

n 1 xA(x)A(y) + xA(y)D+ 1 (x) + yA(x)D^ 1 (y) \ 

(1 - n 0 x)A(x)A(y) - xA(y)D+ 0 (x) - yA(x)D^ 0 (y)J 

where D(x,y) is the determinant of the previous displayed matrix. 

On the other hand, we have 


N_(s) 


(A J_ (r2(x) r^xjV r 0 (x) -r^VA 

W A W\ r 3W r^A-FrA) r 0 (2:) J\iJ 


1 / N o 0*0 \ 

A(x) \Ni(x)J 


with 

Nq(x) = A(x) - (r 0 (x) - Ti(x)) (ri(x) + r 2 (x)), 

N i( x ) = A(x) - (r 0 (x) -r 1 (x))(r 2 (x) + r 3 (x)). 

Next, we calculate N-j-(y): 

1 _ y_ ( D oo(y) D oi(y)\ /A _ _j_ ( A(y)\ 

1 I A(y) \Di 0 (y) D^(y)JvJ ~ A(y) \Nl(y)J 

with 

N o(v ) = (1 - (1 - 7Ti - 7r 2 )y)A(y) - y£>oo(y) - yD 31 {y) 

= (1 - (1 - 7T1 - 7T 2 )y)A(y) - y(r 0 (y) - r 1 (y))(Tr 1 T 1 (y) + (tti + 7T 2 )r 2 (y) + 7T 2 r 3 (y)), 
N i(y) = (! — (! — n 2 )y)A(y) - yD^ 0 (y) - yD^(y) 

= (!-(!- 7T2)y) A(y) - 7r 2 y(r 0 (y) - Fi(y)) (ri(y) + r 2 (y)). 


N t(y) = 


7T 0 7Tl 7T 2 0 \ 

7Tl 7T 0 7Ti TT 2 J 


(7.11) 
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As a by-product, we obtain the following representation: 


with 


N 0 (x,y) = 


1 


(1 — x)A(x) 2 

1 


-(M 

[((1 - 7r 0 x)A(x) - xD£ q (x))Nq(x) - x(n 1 A(x) + £>oi(x))iVf(x)] 

4(y)-1, 


(7.12) 


(1 — J/)A(j/)" 0 

Ni(x,y) = 7- [-x(ttiA(x) + D^ 0 (x))Nq(x) + ((1 - 7r 0 x)A(x) - xD^ 1 (x))N^(x)] 


(1 — x)A(x) 2 

1 

(1 -y)A(y) 


Nl(y)-1. 


• Third step: deriving the generating matrix K 

In view of (14.161) . we write K (x,y) as K (x,y) = D(x, y) _1 N(x, y) where 

t)(x,y) = I — wxfdj r {x) — myf)—(y), 


with 


N(x,y) = [I - n7xl) + (x)] [ml + —— N+(x)] + [I - myt)-{y)] [ml + —N_(y)] - ml, 

lx l y 

D+(x) = D+(x)(I - xP)" 1 , £>_(</) = D_(j/)(I - yP)- 1 , 

N+(x) = P+(1 -r=(x)r(x)- 1 i), n_( 2/) = P-(1 - rt(2/)r(2/)- 1 i). 


For instance, 


D + (x) = 


1 


with 


i5(x)A(x( 


■D + (x) 


1 — 7TqX 7TlX 


'£>00 ( x ) An 0*0' 


7T lX 1-7T0 xj S(x) A(x) \D+(x) D+(x) 


AJcA) = 7T2[7Tixr 0 (x)ri(x) + (i - 7r 0 x)r 0 (x)r 2 (x) - (1 - 7r 0 x)ri(x ) 2 - 7rixri(x)r 2 (x)], 
D^(x) = 7t 2 [(i - 7r 0 x)r 0 (x)ri(x) + 7r 2 xr 0 (x)r 2 (x) - 7rixri(x ) 2 - (i - 7r 0 x)ri(x)r 2 (x)], 
Dto( x ) = 7T 2 xr 0 (x)ri(x) + 7ri(i + ( 7 r 2 - 7To)x)r 0 (x)r 2 (x) + 7r 2 (i - 7rox)r 0 (x)r 3 (x) 

- 7Tl(l - 7T 0 x)ri(x ) 2 - (tT 2 + (7T 2 - 7T 0 7r 2 )x) Ti (x)F 2 (x) - 7Tl7T 2 X Tl (x)F 3 (x), 
Z)+(x) = 7Ti(l - 7r 0 x)r 0 (x)ri(x) + (7T 2 + (7T 2 - 7T 0 7r 2 )x)T 0 (x)r 2 (x) +7ri7r 2 xr 0 (x)r 3 (x) 

- 7T 2 xFl(x ) 2 - 7Tl(l + ( 7 r 2 - 7T 0 )x)ri(x)r 2 (x) - 7T 2 (1 - 7T 0 x)ri(x)r 3 (x). 

Similarly, we obtain that 

1 (Dqo{v) Dqi (y)\ 


D-(2/) = 


with 


S(y)A(y) \ o-( y) f)^(y) 


Dooiy) = 7Ti(l - 7To2/)r 0 ( 2 /)r 1 (y) + ( 7 r 2 + ( 7 r 2 - 7r 0 7r 2 )i/)r 0 ( 2 /)F 2 (j/) + n 1 Tr 2 yT 0 (y)T 3 (y) 

- Ttlyh'iiy) 2 - 7Ti(l + (tt 2 - TT 0 )y)T 1 (y)T 2 {y) - tt 2 (1 - ■n 0 y)T 1 {y)T 3 (y), 

Dqi (2/) = 7r iy r o( 2 /)ri( 2 /) +7Ti(l + ( 7 r 2 - Tr 0 )y)r 0 (y)T 2 (y) + 7r 2 (l - 7r 0 2/)r 0 ( 2 /)F 3 ( 7 /) 

- 7Ti(l - n 0 y)T 1 (y) 2 - ( 7 r 2 + ( 7 r 2 - 7r 0 7r 2 )2/) T 1 ( 2 /)T 2 ( 2 /) - 7Ti7t 2 2 / Ti ( 2 /)F 3 ( 2 /), 
Dio(y) = ^[(l - 7To2/)ro(2/)ri(2/) +7Ti2/r 0 (2/)r 2 (2/) - n iy Ti(y) 2 - (1 - 7T 0 2/)r 1 ( 2 /)r 2 (y)], 
Dn(y) = tt 2 [ttij/F 0 ( 2 /)r 1 ( 2 /) + (1 ^ 7To2/)r 0 (2/)r 2 (2/) - (1 - 7T 0 2/)ri(2/) 2 - TTiyr 1 ( 2 /)r 2 (y)]. 


With this at hand, 

D(x,2/) _1 = 


-1 _ S(x)6{y)A(x)A(y) (S(x)S{y)A(x)A(y) - mxS{y)A(y)D^ 0 (x) - myS(x)A(x)D 00 (y) 


D(x,y) 


mxd(y)A(y)D^ 1 (x) + myS(x)A(x)D 01 (y) 


mx6(y)A(y)D^ 0 (x) + myS(x)A(x)D 10 (y) 
5{x)S{y)A(x)A(y) - mx6{y)A(y)Df 1 (x) - myS{x)A(x)D^ 1 (y) 


(7.13) 


where D(x,y) is the determinant of the previous displayed matrix. 
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Concerning N(x), 


N+(x) 



_\_(V A (x) r 3 (x)\/r 0 (x) -ri(x)Vl\ 
A (a;) \ r 5 (a?) r 4 (aOA _ri ( ;c ) r o(£) A 1 / 


1 Ao + (*)\ 

A(x) \N+(x)J 


with 

iV 0 + (x) = 7r 2 A(x) - 7r 2 (r 0 (x) - r 4 (x)) (r 3 (x) + r 4 (x)), 

N^(x) = (7Ti + 7T 2 )A(x) - (r 0 (x) - Ti(x)) (7Tir 3 (x) + (7Ti + 7r 2 )r 4 (x) + 7r 2 r 5 (x)). 


Similarly, 


with 


N ~(y) 


1 p 0 “(y)\ 

A(y) \N^(y)J 


A (y) = (tti + 7r 2 )A(y) - (r 0 (y) - Fi(?/)) (7rir 3 (y) + (tti + n 2 )T 4 (y) + Tr 2 T 5 (y )), 

Ni{y) = tt 2 A (y) - 7r 2 (r 0 (y) - ri(y))(r 3 (y) +r 4 (y)). 


As a by-product, we obtain the following representation: 


with 


N 0 (x,y) = 


1 - 


<5(x)A(x) 


N (x,y) = 


DM 


N 0 {x,y) 

Ni(x,y) 


wx £)+ ( x ) 

S(x) A(x) 0l[X) 


(1 — x)A(x) 

X 


N+(x) 


m - 


1 - 


my 


Doo(y) 


Ni(x,y) = - 


S(y)A(y) 

wy DM 

Dto(x) 


(1 — x)A(x) 

y 


iV+(a 


6(y)A(y) 
mx 

5(x) A(x) 

^ mx 


m 


y 


m - 


(l-I/)A(y)‘ 0 

Nr(y) 

N^(x] 


No(y) 


<5(x)A(x) 
my 


Du ( x ) 


(1 - y)A(y) 

X 

(1 - x)A(x) iV ° 

X 


'UJ i 


(1 — x)A(x) 


fV+(x) 


<%)A(y) 

my 


DM 


VO - 


(l-y)A(y)^ 0 


A“(y) 


1 - 


%)A(y) 


Ai(y) 


(1 -y)A(y) 


A“(y) 


(7.14) 


□ 
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